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Abstract 

The paper presents necessary and sufficient conditions for a noniinear 
system to be stabilized by a feedback. The conditions are based on the 
ideas related to the well-known Pontryagin's maximum principle. That 
allows us to formulate the results in terms that are valid for continuous, 
discontinuous, stationary and time-dependent feedbacks. 

1 INTRODUCTION 

Stabilization is one of the central topics of control theory. It was shown in [I], 
[3] i [S] , PH] that the class of continuous stationary feedbacks is too restrictive for 
the purposes of stabilization of nonlinear systems. In other words, in order to 
design a continuous feedback stabilizer one needs to use functions depending on 
time and state [TT] , [TO] . To stay with the class of stationary feedbacks one has 
to deal with piecewise continuous functions [I] , [5] • The synthesis procedures for 
both continuous and piecewise continuous stabilizers are developed only for some 
special types of systems. For example, in [8], [S] it is shown how to construct 
stationary piecewise continuous stabilizers for generic two-dimensional affine 
nonlinear systems. On the other hand, the papers [11], [15], [16] show how to 
design feedbacks for certain types of nonholonomic systems. Both approaches 
(nonstationary continuous, and stationary discontinuous) are quite complicated 
as far as the feedback synthesis is concerned. 

This paper presents necessary and sufficient conditions for a nonlinear system 
to be stabilized by a feedback. The main results are presented in terms that are 
valid for continuous, discontinuous, stationary and time dependent feedbacks. 
Our approach is based on the properties of the Pontryagin type Hamiltonian 
systems. The proposed sufficient conditions lead us to an effective feedback 
synthesis procedure that allows to construct piece-wise continuous stabilizing 
feedback laws for a general nonlinear system. 
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2 PRELIMINARIES 

Consider a system 

x = f(t,x,u) (1) 

where u is the control input; x denotes the state of the system and x G R™, R" 
- n-dimensional linear real space. f(t,x,u) is a vector held: 

V(i, x, u) G R x R" x R m /(t, x, u) G R™ 

and f(t,x,u) is continuously differentiable with respect to (t, x, u). We write 
/ G C 1 . Throughout the paper we assume that R™ is equipped with the scalar 
product and ||x|| denotes the magnitude of x, i.e |[x|| = y (x, x), where (x,x) is 
the scalar product of x with itself. 
Consider the initial value problem 

= f(t,x,u(t,x)), 

(2) 

x(i ) = x , 

where / £ C 1 and x) is the feedback. Its solution is defined in Filippov's 
sense [IT) . 

Let x = be the Filippov solution for |T]) where i 6 R and u — u(t, x) is 
a feedback law. We call such solution an equilibrium of (JTJ. The goal of this 
paper is to hnd necessary and sufficient conditions for the feedback 

u = u(t, x) (3) 

to stabilize the system (JTJ at the origin over a compact set K C R™ . Throughout 
the paper we assume that u{t, x) takes its values from a compact subset 

S1CR™ (4) 

The stabilization is defined as follows. 

Definition 1 The system (QP is said to be stabilizable over a compact set K C 
R™ by the feedback |3|) if the solutions x{t, ioj^o) of the closed loop system 
satisfy the condition 

lim x(t, to, xo) = V xq G K, (o£R. 

t — >oo 

and the equilibrium is stable. 



3 NECESSARY AND SUFFICIENT CONDI- 
TIONS 

Our main goal is to find necessary and sufficient conditions for the feedback ([3]) 
to stabilize the system ([1]). Consider the optimal control problem (with free 
end) 
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T d 

—V(t 7 x(t,t Q ,x ))+ 



d 

(—V(t,x(t,t ,x )),f(t,x(t,t ,x ),u(t)))dt -> inf 

OX u(t) 



(5) 



where V(t,x) is a Lyapunov type function (see [2], [TB]) and x(t,to,xo) is the 
solution for 

= f(t,x,u), 

(6) 

x(t ) = £o, 

where the control input it takes its values from the set 51 defined in 

The existence of the optimal solution for , © was studied in great details 
[2]. For simplicity we assume that 

—f(t,x,u) and —f(t,0,u) 

are uniformly bounded for (i, x, it) € R x R™ x £1 : 3 Q > such that 
V t e R, .x e R n , u e 

||J^/(t, < Q • ||x|| 

and (7) 

\\^-f(t,0,u)u\\ < Q.\\u\\. 
ou 

Then the existence of the optimal trajectory for any Xq follows from the 
classical Arzela's theorem. The conditions © can be relaxed (at the expense 
of the simplicity of formulations) with the help of the results from [5] 

The necessary conditions for optimality are provided by Pontryagin result 
[12]. Let 

d 

H(iP,t,x,u) = —V(t,x) + 
at 



(-^V(t,x)J(t,x,u)) + (i>,f{x,u)). 



Then the optimal solution satisfies 



d 

x = —H(ip,t,x,u), 
d 
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where ip(T) = and u = u{t, x, tp) is the solution for 

H(ip, t, x, u) — > inf . 

Introduce notations 
and 

S(v,t,x,u) = (v, f(t,x,u)). 
Then the Pontryagin necessary conditions of optimality take the following form 

d 

x = —S(v,t,x,u), 
av 

(8) 

S(y,t,x,u), 



dx 



where v{T) — -g^V(T, x(T, xq)) and u — u{t, x, v) is the solution for 

S(p,t,x,u) — ► inf . (9) 

Now we can formulate our necessary conditions of stabilization. 

Theorem 3.1 If the system with f G C 1 and ^ is stabilizable over K, 
then 

V 5 > 0, < 6 R, x Q E K 
3 u S R", andT>0 
such that for the solution (x(t), v(t)) of wzi/i i/ie initial conditions 

x(t ) = x , v(t ) = u 0) 

we have 

\\x(T)\\<6. 

and 

v{T) = x(T). 

Proof. Let the system ([T]) be stabilizable by a feedback u(t, x) over a com- 
pact set K. Then 

Vio € R, xq e K lim to, £o) = 0, (10) 

t — >oo 

where x u (t, to, xq) denotes the solution of the initial value problem 

*(*) = f(t,x,u(t,x)), 

x(t ) = Xq. 



We need to prove that for any S > 0, to £ R and any xq 6 K C R n there 
exist z^o G R™ and T > such that 

||x(T)|| < 5 and v{T) = x(T) 

where x(t) is the rr-part of the solution (x(t), v(t)) of (jHJ), (jSJ. 

Consider the extremal problem ([5]), ©, where V(t,x) = ^||a;|| 2 . It follows 
from and the classical Arzela's theorem that the optimal solution exists. 
Hence, it satisfies Pontryagin necessary conditions, 

MT)\\ < \\x u (T,to,x )\\, v{T) = x(T) 
and (fTQ|) yields the existence of T > such that 

IKT)||<<5 and v{T) = x(T). 

Q.E.D. 

Let u = u(t, x, v) denote the control such that 

(v, f(t, x, u(t, x, v))) = mUv, f(t, x, u(t, x, v))). 

Then it follows from 

(u, f(t, x, u(t, x, v))) < (u, f(t, x,u)) VueJ] 

that for any A > 

(Xis, f(t, x, u(t, x, v))) < (Xu, f(t, x, u)) V u G fi. 

Hence, for A > u(t, x, X ■ v) — u(t, x,u) and the Hamiltonian S(t,x,u) — 
S(u, t, x, u(t, x, v)) has the following important property 

S(t,x,Xv) = XS(t,x,v) for A>0. (11) 

Thus, 

v ■ dx — 

is preserved along the solutions of the system (JSj) , ([9]). Consider the (n — 1)- 
dimensional manifold Ms defined as 

v = gradV(x) and V(x) = 5, 

where S > and V(x) is a Lyapunov function. Clearly, restriction of the 
differential form v-dxto this manifold is equal to zero. The Lagrangian manifold 
Ls defined by the trajectories of {8]), ([9]) emitted from Ms plays an important 
role in analyzing stabilization and in designing feedback stabilizers. In order 
to illustrate the significance of Ls for the stabilization problems we turn our 
attention to stationary control systems having the form 

x = f(x,u). 
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The Lagrangian manifold L$ we define as the set of trajectories for 

S{y, x, u) — > inf 

x = --^-S(v,x,u), 
ov 

(12) 

v = —S(u,x,u), 
emitted from the manifold Ms, where 

S{v,x,u) = (v,f(x,u)). 
Taking a hxed point xo £ M$ we obtain the function 

W{P) = f vdx + V(x ) (13) 

W{P) is well defined on Lg. 

The property pip implies the Guigens principle for the propagation of 
"light" described by (fT2"|) . In other words, the property (JTTJ) suggests (see [5]) 
that we can treat stabilization similar to a problem from optics. In the termi- 
nology of optics Theorem 13 . II states that for the system to be stabilizablc at the 
origin over a compact set K it is necessary that the sources of "light" located 
on the surface of any tiny ball centered at the origin illuminate all points from 
K. The tiny ball can be replaced by the set where V{x) < e. Moreover, the wave 
fronts are defined by the projections to x-space the level sets of the function 
W(P). Under certain conditions (see [8]) Theorem l3.1l is not only necessary but 
also sufficient for stabilization. Moreover, the Pontryagin's principle hints the 
form of the feedback stabilizer outside the set where V(x) < e. In other words, 
the following statement takes place. 

Theorem 3.2 Let the system 

x = f(x,u) 

be locally stabilizable at the equilibrium x = 0. Moreover, there exists a stabilizing 
feedback law u — w(x) and a Lyapunov function V{x) such that for sufficiently 
small e > we have 

(gradV(x)J(x, w(x))) < for < V(x) < e. 

If the Lagrange manifold L £ is such that the restriction of u(u,x) (from (lty)) 
to L £ is a function of x then the system is stabilizable over any set K which is 
covered by the natural projection of L e onto the x-space. 

Proof. We follow the ideas presented in [8] and choose the feedback u — u(x) 
equal to w(x) for all x such that V(x) < e. On the other hand, if V(x) > e and 
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x belongs to the projection of L e onto the x-space then we define the feedback 
as 

u = u{v, x), 

where the function u{v, x) is defined by (|12p along the lines of well-known Pon- 
tryagin's procedure and u = u{u, x) is a function of x by the assumption. 

Q.E.D. 

Theorem 13.21 suggests an efficient feedback design procedure. However, it 
tacitly imposes some restrictions in the form of requirements fulfilled by certain 
properties of the Lagrangian manifold L £ . Although the stabilization problem 
can be reformulated in optical terms the machinery of Lagrangian manifolds 
and symplectic geometry is not readily available for the control problems. The 
main obstacle here lies in the lack of smoothness of the corresponding Hamil- 
tonian. However, since the property (|lip implies the Guigens principle for the 
propagation of "light" described by (fT2"]) the Lagrangian manifold L e can be 
constructed numerically. Moreover, if the Lagrangian manifold L £ does not ad- 
mit the parametrization by x then the corresponding feedback can be designed 
(for some applications) with the ideology provided by the theory of viscosity 
solutions (see, e.g., [5]). 

Theorem l3.2l leads us to an effective design synthesis of feedback laws suitable 
for various applications of control theory. The format and the size of this brief 
note does not allow us to consider in details various applied versions of Theorem 
13.21 We only illustrate the power of Theorem l3.2l bv the results on stabilization 
of an affine nonlinear system with one control input, 

£(/,&): x = f(x)+b(x)u, 

where x € R™ and f(x),b(x) are C°° vector fields on R™. We assume that 
/(0) = and the control u takes its values from [—1, 1]. Then ([12]) yields 

x = -f(x) + sgn((u,b(x)))-b(x), 

(14) 

v = (-^f(x)) T v~sgn((v,b(x)))-(-H-b(x)) T v, 
where sgn((v,b(x))) denotes the sign of (v,b{x)). 

Theorem 3.3 Let the system £(/, 6) be locally stabilizable at the equilibrium 
x = 0. Moreover, there exist a stabilizing feedback law u = w(x) and a Lyapunov 
function V(x) such that for sufficiently small e > we have 

{gradV{x), f(x) + b{x) ■ w(x)) < and \w(x)\ < 1 

when < V(x) < e. Assume 

(gradV(x)J(x) + b(x) ■ w(x)) < for V(x) = e (15) 

and 

<v,ad s b{x)>^Q. (16) 
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for any point (x, v) from the Lagrange manifold L e such that 

{v,b{x)) = Q. (17) 

Then the system is stabilizable at the origin over any set K which is covered by 
the natural projection of L £ onto the x-space. 

Proof. Consider the coordinate charts (ip, r) on the Lagrangian manifold 
L £ , where ip denotes local coordinates on the surface 

V(x) = e 

and r is the parameter along the solutions of (I14[) known as bicharacteristics 
(see. e.g., [6] for details and further references). Due to the special form of (| 14[) 
and the condition (|T5|) we obtain with the help of Liouville theorem that the 
Jacobian 

, dx dx. 

is not equal to zero along the bicharacteristics. Therefore, the Lagrange manifold 
L £ locally admits a generating function W(x) (defined as (fT"3|) . see also [7]). 
Hence, the control 

dW 

v(x) = -sgn({v,b(x))) = -sgn(( — ,b(x))) 

depends only on x as long as the solutions of (|14p are transverse to the switching 
surface defined by (fTT)) . The latter is assured by (fTBjl . 

Q.E.D. 

To illustrate an application of the Pontryagin's stabilization principle pre- 
sented in this paper consider the system 

xi = x 2 , 

±2 = U. 

We show that for any number C > this system can be globally stabilized at 
the origin by a piece-wise smooth feedback 

u = u(x) such that \u(x)\ <C ViG R 2 . 

Consider the Pontryagin Hamiltonian 

S(x,u) = v\ ■ x 2 - \v 2 \- 

The system corresponding to (fT2|) takes the form 

±i = ~x<2, 
±2 = sgn(u 2 ), 



8 




and 

vi = 0, 
v 2 = v\ 

where sgn(z) denotes the sign of z. The "light" emitted from the points of the 
circle of radius 5 centered at the origin illuminates all points outside the disk 
(FiglB). 

Moreover, the feedback 

w(x) — —X\ — X2 

stabilizes the system over the disk of radius 8 and the disk is invariant with 
respect to the closed loop system. Outside the ball we define a piece-wise con- 
stant control as shown in Fig|2l The constant 5 as well as control values —k, k 
can be chosen so that 

|«(ar)| < C VieR 2 . 

Notice, that for 6 = 1 the switching curve (the curve where the control switches 
between the values — k and k) is defined by 



sin(r)| sin(r) sin 2 (r) 

= o 2 f \ + TT+ cosr 

2-cos^(t) cos(r) 



x 2 = -— + sm(r), 

cos(t) 



where | < r < 7r and \ < r < 2 
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Figure 2: The feedback design outside the disk. 

Consider the afhne nonlinear system having the form 

£(/,&): x = f(x)+b(x)u, 

where f(x), b(x) : R 2 — > R 2 are twice continuously differentiable mappings. 
Following the scenario from Chapter 2 of [9] we introduce the equilibrium set 

ip-^O) = {x E R 2 ; det{f{x),b{x)) = 0}. 

Making use of the theory developed in [9] (see Chapter 2) we come to the 
following result. 

Theorem 3.4 7/ 

ranfc{&(ar),ad/&(a;)} = 2 VieR 2 (18) 

then the bang-bang controllability o/S(/, b) implies its global (semi-global) sta- 
bilization at any equilibrium from y; _1 (0) by a piece-wise smooth feedback u{x) 
such that 

\u{x)\ < 1 Vi6R 2 . 

Proof. It follows from (|18[) (see Chapter 2 from [S]) that for any point 
from the equilibrium set one can construct a locally stabilizing feedback and 
the corresponding Lyapunov function. Moreover, 

{v,ad f b) ^ 

when (v, b) = 0. Hence, by Theorem 13.31 there exists the stabilizing feedback for 
system X(/, b). 
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Q.E.D. 

Theorem 13.41 leads us to an efficient controller design procedure for manip- 
ulators. In order to illustrate its application consider a manipulator defined 

by 

X\ = x 2 

(19) 

*2 = f(xi,X 2 ) + U, 

where f{xi,x 2 ) is a smooth function such that 

/(0,0) = 0. 

Suppose we can measure only xi(t) and x 2 {t) is not available for us. Then we 
design the stabilizing feedback law in the following two steps. 

i. Design the feedback u(x\, x 2 ) with the help of Pontryagin's principle. 

ii. Construct an estimator for x 2 and replace u{x\, x 2 ) with u{x\, z 2 ), where 
z 2 is the corresponding estimation for x 2 (t). 

The first step has been already described in details in this paper. Now we 
outline the construction of the estimator mentioned in the second step and then 
show that the resulted feedback law delivers stabilization for the manipulator 
(|19[) under some generic conditions. 
The estimator is given by 

Zi = z 2 - Px(zi - xi) 

(20) 

z 2 = f{xi,z 2 ) +u(x 1 ,z 2 ) - (h(zi -xi), 

where Pi, (3 2 are positive real numbers. Let W(x\,x 2 ) denote the generating 
function (|13p corresponding to the Pontryagin's type control u(xi,x 2 ). Then 
the following statement takes place. 

Theorem 3.5 If the system H9\) is bang-bang controllable and 

d 

f{xi,x 2 ), W(X!,X 2 ) 

ax 2 

are globally Lipschitz with respect to the second argument then there exist real 
positive numbers (3 2 such that the Pontryagin's type feedback law u(xi,z 2 ), 
where z 2 is calculated by i20\) stabilizes the system M9\) at the origin. 

Proof. By Theorem l3.4l there exists a Pontryagin's type feedback u(xi,x 2 ) that 
stabilizes the system at the origin. Since x 2 (t) is not available for us we need 
to use estimator (|20j) . Consider a Lyapunov function with e\ = z\ — X\ and 

62 = z 2 — x 2 : 

V = 2^e 2 1 -2e 1 -e 2 + (^ + ^-)e 2 2 , 

PI Pi P2 
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where p\, j3 2 are positive numbers. Differentiating this function with respect to 
the closed loop system (it = u(xi,z 2 )) (fl9|) . |20|) yields 

at 

2 • (-ex + (|- + ^)e 2 )(/(x 1 , z 2 ) - /(^i,^)) 

Pi P 2 

Taking into account that 

1/(0:1,22) - /(aci,ar 2 )| < L ■ \z 2 - x 2 \ V xi, x 2 , z 2 



and 

wc obtain that 



2|ei • ea| < (y) 2 + (<J ■ e 2 ) 2 

|F< ( -2/ 32 + ^.L).e? + 
(-2 + 5 2 .i + (A + |). L ). e 2 

Pi P2 

It is evident that for any L > there exist <5 > and positive p\ , #2 such that 

-2/3 2 + 1 ■ L < 



and 

-9 -4- & ■ J, + 1 

'Pi 02 



2 + S 2 .L + (^ + ^)-L<0. 



Hence, (see, e.g., [T3]) 

e\(t) — > and e 2 (i) — » as t — > 00. 
Now let us differentiate W / (xi,x 2 ) with respect to the closed loop system p^|) . 

4-W = z/i • x 2 + v 2 {f{xi,x 2 ) + u(xi,x 2 )) + 
at 

u 2 (u(xt, z 2 ) - u(x 1 ,x 2 )), 

where 

<"■• - far* ^ H '>' 

By construction of the Pontryagin's type feedback there exist a positive number 
7 > such that 

v x ■ x 2 + v 2 {f{xx,x 2 ) + u(xi,x 2 )) < -7 

for all (u, x) from the corresponding Lagrangian manifold. -^W(x\, x 2 ) is 
globally Lipschitz with respect to the second argument: V x%, x 2 , z 2 

d d 
\—W(x u x 2 ) - —W(x u z 2 )\ < M ■ \x 2 -z 2 \. 
ox 2 ox 2 
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Taking into account 



d 

u{xi,x 2 ) = -sgn(-Q—W(x 1 ,x 2 )) 



we have 

d d 
— W{xi,x 2 ) ■ (-sgn(—W(x 1 ,z 2 ))+ 

d 

sgn(—W(x!,x 2 ))) = 

d d d 

{ dx^ W(XuX2) ~ dx^ W(XuZ2)) ■ (~ s 9n(-^W(x u z 2 )))+ 



1^^)1-1^1,^)1. 



Hence, 



\v 2 {u{xi,z 2 ) -u{xi,x 2 ))\ < 2M\e 2 (t)\ 
Since e 2 (t) — > as t — > oo one can find T > such that 



Thus, 



M«(a;i,afc)-u(a;i,a;2))| < 2M|e 2 (t)| < | V t > T. 



and at some moment of time the solution will arrive at the neighborhood of the 
origin where one can switch to the feedback control constructed with the help 
of the classical linear theory. 
Q.E.D. 
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